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METHODS AND APPARATUS FOR DETERMINING A DIRECTION OF ARRIVAL 
IN A WIRELESS COMMUNICATION SYSTEM 



FIELD OF THE INVENTION 
5 The present invention generally relates to wireless communication systems, and 

more particularly to methods and apparatus for determining a direction of arrival (DO A) of 
a signal transmitted by a remote unit in a wireless communication system. 

: BACKGROUND OF THE INVENTION 

ft 0 There are numerous applications that can use the location of a remote unit in a 

wireless communication system. For example, the location of the remote unit can be used 
for emergency services, so that police, fire and/or medical services can be dispatched to the 
location of the subscriber requesting such an emergency service. In addition, the location 

□ of the remote unit can be used in detecting fraudulent use of the communication system, 

1 5 police investigations, and the like. Furthermore, the location of a remote unit can be used to 
improve performance of the wireless communication system. For example, wireless 
communication systems that utilize beam-forming transceivers can tune the beams based at 
least in part on the direction of arrival (DOA) of a signal transmitted from the remote unit. 
DOA is often an important parameter used in location determination. 

20 Wireless communication systems currently have the capability for determining the 

location of a remote unit. However, increased resolution for the DOA of a signal from the 
remote unit is continually sought for these communication systems. (See H. Krim and M. 
Viberg, "Two Decades of Signal Processing Research," IEEE Signal Processing Magazine, 
Vol. 13, No. 4, July 1996 (hereinafter referred to as the "Two Decades Reference"), which 

25 is hereby incorporated by reference.) In order to improve the resolution for the DOA of a 

1 
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signal from a remote unit in a wireless communication system that utilizes an array of 
antennas (i.e., antenna array), the methods and apparatus for determining the DOA 
preferably address array distortions. 

Array distortions, which collectively refers to a wide variety of distortions and 
modeling errors, can be attributed to any number of factors, including physical 
manufacturing differences between antenna arrays, mutual coupling between elements of 
antenna arrays, mutual coupling between elements of arrays and metallic resonators, 
differences in the connection lengths between array elements, characteristic differences of 
transceivers that are processing signals received from the elements of antenna arrays, and so 
forth. These array distortions are known to be sources of degradation to DOA estimation 
accuracy, and methods and apparatus have been proposed to compensate for array 
distortions. 

For example, direction-finding (DF) techniques have been developed that determine 
DOAs of multiple simultaneously detected co-channel signal sources, including the Multiple 
Signal Classification (MUSIC) and the Estimation of Signal Parameters via Rotational 
Invariance Techniques (ESPRIT). (See R.O. Schmidt, "Multiple Emitter Location and 
Signal Parameter Estimation," IEEE Transactions on Antennas and Propagation, Vol. AP- 
34, No. 3, March 1986, pp. 276-280, which is hereby incorporated by reference, and U.S. 
Patent. No. 4,750,147 titled "Method for Estimating Signal Source Locations and Signal 
Parameters using an Array of Signal Sensor Pairs," issued to Richard H. Roy, III et al. on 
June 7, 1988, which is hereby incorporated by reference.) MUSIC utilizes pre-recorded 
measurements of the array manifold, so this technique is largely immune to array distortion 
effects. However, MUSIC is an unstructured method and therefore computationally 
intensive as each DOA estimate requires a full scan of the entire array manifold. ESPRIT is 
less computationally intensive as compared to MUSIC as it does not utilize a-priori 
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measurements of the array manifold. However, ESPRIT generally requires identical pairs 
of sensors, which makes it susceptible to many mechanisms that induce array manifold 
errors. 

Calibration of the array manifold, which is commonly used to specify the response 
5 of the antenna array to a stimulus and an idealized response and a composite of the idealized 
response with the effect of array distortions, continues to be a subject that is investigated for 
increasing the accuracy of DOA estimates. For example, investigations have been 
conducted to identify the array manifold distortions that are present in complex 

0 environments. {See A. Leshem and M. Wax, "Array Calibration in the Presence of 
WO Multipart!," IEEE Transactions on Signal Processing, Vol. 48, No. 1, January 2000, pp. 53- 
f 59(hereafter referred to as the "Leshem Reference"), which is hereby incorporated by 

1 reference.) These investigations have shown that calibration for array manifold distortions 
in complex environments does provide the desired increases in the accuracy of DOA 

3 estimation. 

15 In view of the foregoing, is should be appreciated that it would be desirable to 

provide methods and apparatus for determining a direction of arrival (DOA) of a signal. It 
should also be appreciated that it is desirable to provide such methods that are resistant to 
array manifold distortions and that are computationally efficient. Furthermore, additional 
desirable features will become apparent to one skilled in the art from the drawings, 

20 foregoing background of the invention and following detailed description of a preferred 
exemplary embodiment, and appended claims. 



25 



BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention will hereinafter be described in conjunction with the following 
3 
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drawing figures, wherein like numerals denote like elements, and: 

FIG. 1 is a wireless communication system according to a preferred exemplary 
embodiment of the present invention; 

FIG. 2 is the transceiver with direction of arrival (DOA) apparatus of FIG. 1 in 
greater detail according to a preferred exemplary embodiment of the present invention; 

FIG. 3 is the DOA apparatus of FIG. 2 in greater detail according to a preferred 
exemplary embodiment of the present invention; 

FIG. 4 is the coefficient selector of FIG. 3 in greater detail according to a preferred 
exemplary embodiment of the present invention; 

FIG. 5 is a flowchart of a reduction method performed by the coefficient processor 
of FIG. 4 according to a preferred exemplary embodiment of the present invention; and 

FIG. 6 is an illustrative example of DOA ranges, range boundaries and DOA targets 
for which the coefficient processor of FIG. 4 performs the reduction method of FIG. 5. 

DETAILED DESCRIPTION OF A PREFERRED EXEMPLARY EMBODIMENT 
The following detailed description of a preferred embodiment is merely exemplary 
in nature and is not intended to limit the invention or the application and uses of the 
invention. 

FIG. 1 is a block diagram of a wireless communication system 20 that includes an 
apparatus for determining the direction of arrival (DOA) of a remote unit (RU) 22 according 
to a preferred exemplary embodiment of the present invention. The wireless 
communication system 20 described in this detailed description of a preferred exemplary 
embodiment is directed to a cellular or personal communication system (PCS). However, 
the principles discussed herein can be readily applied to other wireless based, radio, cable 
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television (CATV), telephony or satellite telecommunication systems as well as other data 
communications systems. Furthermore, while the wireless communication system 20 of the 
preferred exemplary embodiment of the present invention is configured to utilize a Code 
Division Multiple Access (CDMA) protocol as described in TIA/EIA Interim Standard IS- 
5 95A, Mobile Station-Base Station Compatibility Standards for Dual-Mode Wideband 
Spread Spectrum Cellular Systems, Telecommunications Industry Association, Washington, 
D.C. July 1993 (hereinafter referred to as the "IS-95A Reference Document"), which is 
hereby incorporated by reference, the wireless communication system 20 may utilize other 
O system protocols such as, but not limited to the Narrowband Advanced Mobile Phone 
to Service (NAMPS) protocol, the Advanced Mobile Phone Service (AMPS) protocol, the 
Personal Digital Cellular (PDC) protocol, the Global System for Mobile Communications 
(GSM) protocol, Two- Way Paging protocols, or the United States Digital Cellular (USDC) 
U> protocol and future generations thereof. 

HF In addition to the remote unit 22, the wireless communication system 20 includes, 

1 15 but is not limited to, a sectorized base site 24 having an antenna array 26 and transceiver 
with DOA apparatus 28 in operative communication with another communication system, 
such as a public switched telephone network (PSTN) 30. The remote unit 22 transmits a 
radio frequency (RF) signal 32 that is received by multiple antennas (34,36,38,40,42,44) 
forming the antenna array 26. The antenna array 26 can have any number of antennas and 
20 any number of antenna array configurations and antenna types can be utilized in accordance 
with the present invention. The RF signal 32 received by the antenna array 26 is provided to 
the transceiver with DOA apparatus 28, which preferably demodulates and decodes the RF 
signal 32 and identifies a DOA and/or DOA estimate of the RF signal 32 transmitted by the 
remote unit 22. 

25 Referring to FIG. 2, the transceiver with DOA apparatus 28 is shown in greater 
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detail, which is configured to decode and demodulate the RF signal 32 and identify a DOA 
estimate (0) 46 of the remote unit. The transceiver with DOA apparatus 28 includes, but is 
not limited to, a RF converter 48, analog-to-digital (A/D) converter 50, despreader 52, 
demodulator 54, signal combiner 56, decoder 58 and DOA apparatus 60. While the 
5 following detailed description of a preferred exemplary embodiment is directed to a 
transceiver with DOA apparatus 28, it should be understood that the DOA apparatus 60 can 
be a separate component of the sectorized base site or located outside of the sectorized base 

?y . site, including with the remote unit. 

The RF signal 32 transmitted by the remote unit is received by the antennas 

Jt> (34,36,38,40,42,44). The antennas (34,36,38,40,42,44) are configured to intercept 
electromagnetic radiation of the RF signal 32 within a selected frequency band. The 

; ; antennas (34,36,38,40,42,44) can be any number of electromagnetic interception devices, 

Z including, but not limited to a wave guide, a coaxial cable, an optical fiber or an infrared 
frequency transducer. The electromagnetic radiation of the RF signal 32 that is intercepted 
15 by the antennas (34,36,38,40,42,44) is converted to analog signals 62 with the RF converter 
48. The analog signals 62 are digitized with the A/D converter 50 to produce digitized 
signals 64 representing the electromagnetic radiation intercepted by the antennas 
(34,36,38,40,42,44) within the intercepted frequency band. 

The RF signal 32 received by the antennas (34,36,38,40,42,44), converted by the RF 

20 converter 48 and digitized with the A/D converter 50 includes multiple scattered rays 
produced by multi-path scattering of the RF signal 32 during transmission from the remote 
unit, with each ray of the multiple scattered rays a separate multi-path reflection of the RF 
signal 32. The multiple scattered rays produced by the multi-path scattering are generally 
arriving from different directions, at different time delays, and generally have different 

25 complex valued amplitudes (i.e., different magnitude and phase components). Therefore, 
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the RF signal 32 received from the remote unit includes multiple scattered rays having 
different complex amplitudes, times of arrival, and DOAs. 

The collection of voltages produced by each scattered ray (r ; ) at a given time (t) on 
the antenna array elements can be expressed, in the absence of noise, as: 

is(t) = c(eos(t-TD (i) 

Where t* is the time delay of ray i, 0j is the DOA of ray i, s(t) is the transmitted signal and 
c(9j) is the composite array manifold resulting from a stimulus having the DOA 9;. A model 
for the vector-valued received signal r(t) with multi-path scattering incorporating N rays can 
be expressed as: 

r(t) = r 1 (t) + r 2 (t) + ...+r N (t) (2) 
In a preferred exemplary embodiment of the present invention, the RF signal 32 with 
the multi-path scattering incorporating N rays is an encoded spread-spectrum digital signal 
having a multiplicity of frequency and time overlapping coded signals from multiple remote 
units within the wireless communication system. The multiplicity of frequency and time 
overlapping coded signals are typically transmitted simultaneously at the same or 
substantially similar radio frequency and are distinguishable through specific modulation 
and spreading. In other words, the RF signal 32 received by the antennas 
(34,36,38,40,42,44) is preferably a composite signal of individual signals transmitted within 
the wireless communication system, and the RF signal of a single remote unit is generally 
distinguishable only after despreading and demodulation. Therefore, the digitized signals 
64 are presented to the despreader 52 and the demodulator 54. More specifically, the 
digitized signals 64 are provided to the despreader 52 for despreading and generation of 
despread signals 66. The despread signals 66, representing the transmission from a single 
remote unit, are subsequently demodulated with the demodulator 54 and demodulated 
signals 68 are produced having in-phase (I) and quadrature phase (Q) components. 
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As previously discussed in this detailed description of a preferred exemplary 
embodiment, the RF signal 32 received from the remote unit generally includes multiple 
scattered rays having different amplitudes, DO As and time delays, therefore the in-phase (I) 
and quadrature phase (Q) components of the demodulated signals 68 have also undergone 
multiple reflections that result in echoes of the in-phase (I) and quadrature phase (Q) 
components. In the preferred exemplary embodiment, the despreading and demodulation 
functions of the despreader 52 and demodulator 54, respectively, isolate the plurality of 
time-delayed rays received by the antennas (34,36,38,40,42,44). The demodulated signals 
68 can be represented by a matrix-valued signal (R) that contains representations of the 
scattered plurality of rays of the demodulated signals 68 and can be expressed as: 

R = [c(9i)h(Ti) c(9 2 )h(x 2 ) c(e 3 )h(T 3 ) ] + N = [n r 2 r 3 ] (3) 
Where N is associated with sources of thermal noise and other noise components of the RF 
signal. The first column (ri) of the matrix-valued signal (R) representation of the 
demodulated signals 68 represents the plurality of prompt rays (i.e., rays arriving at the 
earliest time delay (xO) received by the antennas (34,36,38,40,42,44) and can be expressed 
as: 

ri=[rn ri 2 r 13 r 14 ri 5 r 16 .... n M ] T (4) 
Where M represents the number of antennas in the antenna array. The subsequent columns 
(r2,r3,r4...) of the matrix- valued signal (R) representation of the demodulated signals 68 
represent the subsequent time-delayed echoed rays received by the antennas 
(34,36,38,40,42,44) and can be expressed as: 

r 2 =[r 2 i r 22 r 23 r 24 r 25 r 26 . . . . r M ] T (5) 
r 3 =[r 3 1 r 32 r 33 r 34 r 35 r 36 . . . . r M ] T (6) 
r 4 =[r 4 1 r 42 r 43 r 44 r 45 r 46 . . . . r M ] T (7) 
The scaling values (h(xO) represent a factor due to the time delay of the echoes that is 
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common across substantially all antenna elements. The demodulated signals 68 are 
preferably provided to the signal combiner 56, decoder 58 and DOA apparatus 60 for 
subsequent processing. 

In a preferred exemplary embodiment of the present invention, the signal combiner 
5 56 and decoder 58 are configured to perform CDMA combining and decoding of in-phase 
(I) and quadrature phase (Q) components of each remote unit as described in the IS-95A 
Reference Document. For example, the signal combiner 56 is configured to receive the in- 
U4 phase (I) and quadrature phase (Q) components of prompt rays and the plurality of echo rays 
p and combine the scattered plurality of rays to form one coherent in-phase (I) and quadrature 
TO (Q) signal for each remote unit. This coherent in-phase (I) and quadrature (Q) signal 
generated from the echo rays and scattered plurality of rays is organized into groups of 
JL sampled and predetermined length signals (e.g., groups with a sample length of sixty-four) 
that are independently provided to the decoder 58, which is most preferably an orthogonal 
□ decoder, for subsequent decoding. In addition to generating the coherent in-phase (I) and 
15 quadrature (Q) signal from the scattered plurality of rays for decoding with the decoder 58, 
the DOA apparatus 60 can be configured to generate the DOA estimate (9) 46 from the 
demodulated signals 68. However, it should be understood that the DOA apparatus 60 can 
be configured to generate the DOA estimate (8) 46 from the RF signal 32 received by the 
multiple antennas of the antenna array in any number of signal forms and formats, including 
20 modulated and analog signals. 

Referring to FIG. 3, the DOA apparatus 60 is shown in greater detail, which is 
configured to determine the DOA estimate (9) 46 of the RF signal transmitted by the remote 
unit in the wireless communication system. The DOA apparatus 60 includes, but is not 
limited to a first DOA determinator 70, coefficient selector 72, signal modifier 74 and 
25 second DOA determinator 76. Generally, the first DOA determinator 70 is configured 
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to determine at least one preliminary DOA (0') 78 for the RF signal received with the 
multiple antennas of the antenna array and more preferably determines more than one 
preliminary DOA (8') 78 for the RF signal received at the multiple antennas of the antenna 
array. The preliminary DOA (8') 78 or preliminary DOAs (0') 78 are provided to the 
coefficient selector 72 that selects at least one coefficient (T) 80 and preferably selects more 
than one coefficient (P) 80, which are preferably array distortion or coupling coefficients, 
based at least in part upon the preliminary DOA (9') 78 or preliminary DOAs (G') 78. The 
signal modifier 74 receives the RF signal and the coefficient (IT) 80 or coefficients (17) 80 
and modifies the RF signal to produce a modified RF signal 82, which is provided to the 
second DOA determinator 76 for determination of the DOA estimate (9) 46. 

More particularly, and with continued reference to FIG. 3, the DOA apparatus 60 
receives the demodulated signals 68 of the RF signal received at the antennas of the antenna 
array. However, the DOA apparatus can be configured to receive the RF signal received at 
the antennas of the antenna array in any number of signal formats, forms or representations. 
The first DOA determinator 70 is preferably configured to determine preliminary DOAs (9' 
= [9i' 9 2 ' ... 8 M '], where M is the number of antennas of the antenna array) 78 for the RF 
signal received at the antenna of the antenna array. The first DOA determinator 70 can be 
configured to determine the preliminary DOAs (9') 78 with any number of techniques, 
including, but not limited to, the methods and apparatus described in U.S. Patent 5,786,791, 
titled "Method for Determining an Angle of Arrival of a Signal Transmitted by a Remote 
Unit in a Communication System," issued to Eugene J. Bruckert on July 28, 1998 
(hereinafter referred to as the "Bruckert Reference"), which is hereby incorporated by 
reference, the methods and apparatus described in the U.S. patent application titled 
"Methods and Apparatus for Determining a Direction of Arrival in a Wireless 

10 
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Communication System," naming William F. Alexander, Jr. as the sole inventor and 
having an attorney docket number of CE04453N (hereinafter referred to as the "Alexander 
Reference"), which is hereby incorporated by reference, and any of the methods and 
apparatus presented in the Two Decades Reference. The preliminary DOAs (9') 78 are 
5 provided to the coefficient selector 72 that is configured to select the coefficient or 
coefficients, which are preferably array distortion coefficients (T) 80, but can be any number 
of coefficients. As previously described in this detailed description of a preferred 
exemplary embodiment, the coefficient selector 72 selects the array distortion coefficients 
'% (O 80 based at least in part upon the preliminary DOAs (0') 78 received from the first DOA 
10 estimator 70. 

HI While any number of relationships can be utilized to select the array distortion 

coefficients (T) 80, the array distortion coefficients (T) 80 are preferably selected using the 
relationship between the composite array manifold (c(0)), ideal array manifold (b(9)) and a 
3 pre-multiplying linear distortion term (T(9)), which can be expressed as: 
"l5 c(9) = r(0)b(0) (8) 

The pre-multiplying linear distortion term (T(9)) incorporates the collective effect of the 
array distortions and is angularly dependent. While the effects of array distortion depend on 
the DOA of the RF signal, the array distortions are relatively consistent over a range of 
DOA values (i.e., for small angular ranges relative to a full three hundred and sixty degrees 
20 (360°) DOA range, the array distortions are substantially similar). This can be 
mathematically expressed as follows for a value (x) within a region at or near zero degrees 
(0°): 

r(e)*r(9 + x) (9) 

Referring to FIG. 4, the coefficient selector 72 is shown in greater detail, which is 
11 
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configured to select the array distortion coefficients (T) 80 using the foregoing 
relationships expressed in equations (8) and (9). In this detailed description of a preferred 
exemplary embodiment, the coefficient processor 84 of the coefficient selector 72 initially 
identifies a target DOA (<j>0 for each of the preliminary DOAs (0') 78. For example, the 
5 coefficient processor 84 identifies a target DOA (<j>i) that has a value that is the most similar 
to the preliminary DOA (8;'). Once the target DOA (<j>i) is identified by the coefficient 
processor 84, array distortion coefficients (T((j>i)) are selected from the array distortion 
f=& coefficient database 86 that correspond to the identified target DOA (<j>;). 
O The array distortion coefficient database 86 can be generated prior to operation of 

"10 the wireless communication system, upon activation of the wireless communication system 
and during operation of the wireless communication system. In addition, the array 
rj distortion coefficient database 86 can be generated using any number of techniques. For 
% example, according to a preferred exemplary embodiment of the present invention, the array 
D distortion coefficient database 86 is generated by the database generator 88, which includes, 
1 5 but is not limited to a database processor 90 and a calibration measurement database 92 that 
contains calibration measurements of the antenna array (e.g. array distortion measurements), 
which can be determined by a variety of methods, including, but not limited to the in-situ 
method as described in the Leshem Reference, anechoic chamber or antenna range 
calibration measurements, numerical computation by finite element analysis, and numerical 
20 computation by method-of-moments analysis. The database processor 90 retrieves the 
calibration measurements from the calibration measurement database 92 and preferably 
conducts any number of reduction processes for generation of the array distortion coefficient 
database 86. 

For example, and with reference to FIGs. 5 and 6, a reduction method 134 is 



12 
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illustrated in FIG. 5 according to a preferred exemplary embodiment of the present 
invention for an illustrative collection of DOA targets (94,96,98,100,102), a corresponding 
collection of DOA ranges (104,106,108,1 10,1 12) and corresponding DOA range boundaries 
(114,116,118,120,122,124,126,128,130,132) shown in FIG. 6. The selection of DOA 
ranges, DOA range targets, and DOA range boundaries can be determined by any number of 
methods including, but not limited to correlation analysis. Furthermore, it should be 
understood that the DOA targets (94,96,98,100,102), corresponding collection of DOA 
ranges (104,106,108,110,112) and corresponding DOA range boundaries 
(114,116,118,120,122,124,126,128,130,132) shown in FIG. 6 are only illustrative examples 
and any target, range and boundary value is within the scope of the present invention. 

The reduction method 134 initially selects a first DOA range (e.g., a first range 104 
of FIG. 6) 136. Once the first DOA range is selected 136, the array distortion calibration 
measurements are identified that are within the DOA range 138. The selected array 
distortion calibration measurements identified within the DOA range are linearly averaged 
140, yielding array distortion coefficients. These array distortion coefficients are associated 
with the target DOA for the selected DOA range (e.g. target DOA 94 for the first DOA 
range 104 of FIG. 6) and stored in the array distortion coefficient database 144. 
Subsequently, a query is conducted to ascertain whether each of the DOA ranges have been 
processed during the current execution cycle 146 of the reduction method 134. If each of 
the DOA ranges has been processed during the current execution cycle 146 of the reduction 
method 134, the generation of the array distortion coefficient database is complete and the 
method ends 148. If there are remaining DOA ranges (e.g., ranges 106,106,110 and 112 of 
FIG. 6) to process, the reduction method 134 selects another DOA range (e.g., the second 
range 106 of FIG. 6) 150 and continues with the selection of the array distortion calibration 
measurements within the selected DOA range 138 as previously described until the 

13 
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condition is met that each of the ranges has been processed 146 by the reduction method 
134. Once the condition is met that each of the ranges has been processed 146 by the 
reduction method 134, the component array distortion coefficients are available from the 
array coefficient database. 

Referring to FIG. 4, the distortion coefficients (F((j)i)) associated with the target 
DOAs that correspond to the preliminary DOAs (0') 78 are preferably collected by 
coefficient processor 84 to form the array distortion coefficients (T) 80. The collection by 
the coefficient processor 84 can utilize any number of techniques. For example, the array 
distortion coefficients corresponding to the preliminary DOAs (0') 78 are retrieved from the 
array distortion coefficient database 86 and concatenated to form the array distortion 
coefficients (r) 80 as follows: 

r = [r((|) 1 )r((t) 2 )...r((}, N )] (io) 

Referring to FIG. 3, this collection of array distortion coefficients (r) 80 is provided by the 
coefficient selector 72 to the signal modifier 74. 

As previously discussed in this detailed description of a preferred exemplary 
embodiment, the signal modifier 74 uses the array distortion coefficients (T) 80 to produce 
the modified RF signal 82 that is used by the second DOA determinator 76 to determine the 
estimated DOA 46. More particularly, the signal modifier 74 preferably receives distortion 
coefficients 80 (r) and demodulated signals 68 of the RF signal. The demodulated signals 
68 represented by the matrix valued signals (R) as discussed with reference to equations (3) 
through (7) are modified with the associated array distortion coefficients (T^O) for each 
scattered ray (rj) to provide array distortion compensation and produce each modified 
scattered ray (iV) of the modified RF signal 82 represented by the matrix-valued modified 
signal (R') as follows: 

14 
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ri ' = r%)n = b(9i)h(Ti) + r%)m (11) 

Where nj is a noise term associated with the sources of thermal noise and other noise 

components of the RF signal. While the modification of the RF signal according to the 

relationship expressed in equation (11) employs direct matrix inversion to remove the effect 

5 of array distortions, a variety of additional array distortion compensation methods can be 

used to remove or compensate for the array distortions, including, but not limited to least 

squared error methods, total least squares methods, structured least squares methods and 

maximum likelihood methods, for example. (See P. Stoica, R. Moses, "Introduction to 

D Spectral Analysis," Prentice Hall, New Jersey, 1997, which is hereby incorporated by 

10 reference, and S. Haykin, "Adaptive Filter Theory," second edition, Prentice Hall, New 

Jersey, 1991, which is hereby incorporated by reference.) In a preferred embodiment of the 

present invention, signal modifier 74 is configured to employ one of the array distortion 

£1 compensation methods to each of the columns (r;) of matrix valued signals (R) using the 

*p array distortion coefficients r(§i) corresponding to the columns (r s ) as selected by the 

1 5 coefficient selector 72 to produce the modified RF signal 82. 

The second DOA estimator 74 receives the modified RF signal 82 and determines 

the DOA estimate (0) 46 using any number of techniques, including, but not limited to, any 

of the methods applicable to the first DOA determinator 70. Determination of the DOA 

estimate 46 by the second DOA estimator 76 with the modified RF signal 82 yields the 

20 DOA estimate (9) 46 that has reduced degradation due to the effects of array distortion as 

these effects have been mitigated by the operation of the signal modifier 74 on the RF 

signal. While a first DOA determinator 70 and second DOA determinator 76 are presented 

in this detailed description of a preferred exemplary embodiment, a single DOA 

determinator can be configured to perform the operations of the first DOA determinator 70 

25 and second DOA determinator 76 in accordance with the present invention. In 

15 
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addition, the second DOA estimator can be configured to receive the array distortion 
coefficients 80 (T) according to a second preferred exemplary embodiment of the present 
invention. 

According to the second preferred embodiment of the present invention, the second 
5 DOA determinator 76 is configured to receive the array distortion coefficients (T)80 and use 
additional DOA estimation methods for further improvement in the accuracy of the DOA 
estimate (9) 46. For example, the DOA estimation methods of the Two Decades Reference 

!r can utilized to derive the deterministic or stochastic maximum likelihood cost functions. 

O 

rp These cost functions presented in the Two Decades Reference are modified to configure the 

§=.10 signal modifier 74 to alter the noise covariance matrix and possibly the form of the 

\I orthogonal projection matrix. Alternatively, the signal modifier 74 can be configured to 

y% employ direct matrix inversion and such a configuration would preferably include 

modification that is limited to the noise covariance of the cost functions presented in the 

~ Two Decades Reference. Once this modification to the cost functions is completed, any 

1 5 number of methods can be used to determine the DOA estimate from the modified RF signal 

82, including, but not limited to Iterative Quadratic Maximum Likelihood (IQML), MODE, 

and Weighted Subspace Fitting (WSF) techniques presented in the Two Decades Reference. 

For example, the signal modifier 74 is configured to employ direct matrix inversion, and 

the second DOA determinator is configured to employ a modified IQML or WSF method. 

20 The orthogonal projector for the white noise case can be expressed as follows: 

n x A = B(B H B)" 1 B H (12) 

Where n a is a projection orthogonal to the idealized array manifold, and B is a Toeplitz 

matrix constructed so as to yield the orthogonal projection (For additional information 

regarding construction of the Toeplitz matrix (B), see Y. Bresler, A. Macovski, "Exact 

25 Maximum Likelihood Parameter Estimation of Superimposed Exponential Signals in 

16 
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Noise," IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol. ASSP-34, 
No. 5, October 1986, pp. 1081-1089, which is hereby incorporated by reference). For a 
more general non-white noise case, with the noise having a Hermitian covariance (Rnn), 
equation (12) is modified as follows: 
5 n\ Rnn = R nn 1/2 B(B H R nn B)- I B H R nn H/2 (13) 

Where R nn 1/2 and Rnn" 72 represent the square root factors of Rnn, which can be determined by 
methods including, but not limited to the Cholesky decomposition. This projection is 
further modified to incorporate the array distortion coefficients r((j)i), given that the signal 

g modifier 74 uses a direct matrix inversion as expressed in equation (11), and the projection 

- 1 0 can be expressed as follows: 

J rp^r = R m 1/2 r((() i )- 1 B(B H r(<t) i )- H R nn r((t) I )- 1 B)- 1 B H r(<i) i )- H R nn H/2 (14) 

& The IQML iterations or WSF computations are subsequently performed using the projection 
H expressed in equation (14) rather than the ideal model expressed in equation (12) to yield 
£ the DOA estimate 46. 

"T5 As can be appreciated, the methods presented in this preferred exemplary 

embodiment of the present invention delivers DOA estimates with superior accuracy to 
methods that are either unaware of array distortions or unable to compensate for array 
distortions. Utilization of the signal modifier 74 to reduce the contribution of array 
distortions to the received RF signal mitigates the effect that the array distortions have on 

20 the DOA estimate 46. However, some array distortions perform poorly with only this signal 
modification, so the use of a DOA estimation algorithm modified to compensate for the 
effect of the array distortions and the signal modifications of the signal modifier 74 are 
preferable to deliver estimates of the DOA. The increased accuracy in the DOA estimate 
can be attributed to the improved mathematical model for the received RF signals 68. This 

25 improved mathematical model is made possible by knowledge of array distortion 

17 



PATENT 
CE04625N 

coefficients 78, which are locally applied within the approximate region of the preliminary 
DOA estimates (0') 78. The present invention accomplishes this correction with relatively 
low complexity as compared to exhaustive search methods. Furthermore, a reduced set of 
the array distortion calibration measurements 124 is stored within the array distortion 
database 80. Therefore, the present invention provides desirable results of improved 
accuracy without computationally expensive and storage intensive exhaustive searches. 

While the invention has been particularly shown and described with reference to a 
particular embodiment, it will be understood by those skilled in the art that various changes 
in form and details may be made therein without departing from the spirit and scope of the 
invention, and it is intended that all such changes come within the scope of the following 
claims. 
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